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Abstract 

Feedback control in quantum transport has been predicted to give rise to several interesting 
effects, amongst them quantum state stabilisation and the realisation of a mesoscopic Maxwell's 
daemon. These results were derived under the assumption that control operations on the system be 
affected instantaneously after the measurement of electronic jumps through it. In this contribution 
I describe how to include a delay between detection and control operation in the master equation 
theory of feedback-controlled quantum transport. I investigate the consequences of delay for the 
state-stabilisation and Maxwell's-daemon schemes. Furthermore, I describe how delay can be 
used as a tool to probe coherent oscillations of electrons within a transport system and how this 
formalism can be used to model finite detector bandwidth. 



1 



The feedback control of quantum transport has recently been predicted to give rise to 
several interesting effects such as the freezing of current fluctuations (3)], stabilisation of 



quantum states [13l . |18| and the realisation of a mesoscopic Maxwell's daemon [20|]. In all 



these schemes, the feedback was of Wiseman-Milburn type, in which the control operations 
are performed instantaneously and directly after quantum jumps of the system 23|, |24 



The aim of this contribution is to analyse the effects of delay in the feedback control of 
quantum transport. In particular, we are interested in when the control operations follow 
the jump processes not directly, but rather after some time delay, be it originating from the 
finite-response time of feedback hardware, or introduced deliberately into the control loop. 

Away from a transport setting, delay in quantum feedback has been considered by a 
number of authors, e.g. Amini et al. Q1, Combes and Wiseman jEf, Combes et al. j6j, Nishio 



at al. [17[. In particular, Wiseman [23[ considered, at a formal level, delay in Wiseman- 
Milburn control and has derived a delayed-feedback quantum master equation (QME) in the 
limit of small delay time. Here I rederive this delayed QME using an alternative approach 
that makes it clear that this equation can actually be valid for arbitrary delay, provided 
one assumes that if a jump occurs within the delay time of a previous control operation, 
then the interrupted control operation is skipped. This delayed control scheme results in 
a non-Markovian master equation which, by construction, has well-behaved solutions. To 
enable the calculation of transport properties, I generalise this result to make connection 
with full-countin g st atistics (FCS) of electron transfer 14j by inclusion of counting fields 
(see Poeltl et al. 18| for overview of this procedure without delay). 

With this formalism in place, I investigate the consequences of feedback delay for the 
state-stabilisation of Poeltl et al. 18] and Maxwell's daemon of Schaller et al. | 20l . As 
an example of how delay in control need not necessarily be a negative thing [2l|, 



22 , I 



describe how a deliberately-swept delay can be used as a tool to probe coherent oscillations 
of electrons within a transport system . Finally, I show briefly how this delay formalism can 
be used to model a finite-bandwidth electron-counting detector. 



I. DELAYED FEEDBACK IN THE QUANTUM MASTER EQUATION 

Let us consider a transport system described by the QME, p = Wp, with p = p(t) the 
reduced density matrix of the system (e.g. quantum dot) at time t and superoperator W 
the Liouvillian of the system [2| . Let the Liouvillian be decomposed as W = Wo + J , where 
J = J2 a describes quantum jump processes — in particular those in which electrons 
enter and leave the system — , and Wo describes the evolution without jumps. In terms 
of the Hilbert space jump operators L a , we have Wop = — i [H,p] — | {J2 a L^La, p} and 
J a p = L a pL\, such that W is of Lindblad form. 

An intuitive picture of feedback control can be obtained by considering the solution of 
the QME in terms of quantum trajectories 

p[t) = V / dt n . . . / dh Q {t n - t n _ x )J . . . JQ {t 2 - tJJQofa) p(0), (1) 
t^Jo Jo * > ' 

n jumps 

with Qo(t) = e Wot . A sketch of a trajectory for transport through a quantum dot is shown 
in Fig. [U 

Feedback control can be added to this scheme by considering that after each jump J a 
we operate on the system with control operator C a , assumed instantaneous. In standard 
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FIG. 1. A sketch of a portion of a quantum trajectory of a transport system coupled to two 
leads. Time flows from right to left (the same direction as the operators act in Eq. ([I])), jump 
processes from the left lead {Jl) transfer electrons to the system, whereas as jumps to the right 
lead {Jr) remove electrons. In the strong Coulomb blockade regime, the system occupation N 
correspondingly switches between and 1. With delayed feedback in effect, the control operations 
Cl are applied a time r after every left jump except when that jump is followed by the next within 
the delay time. In this latter case, the control operation is skipped. This "control-skipping" is 
depicted for the middle pair of jumps, where the cross indicates that no control operation is applied. 



Wiseman-Milburn control, each jump is followed immediately with the control operation. 
The trajectories including control operations can then be resummed, such that the density 
matrix evolves under the action of the modified control Liouvillian Wc = Wo + ^)2, a C a J a . 

We now want to consider a delay between jump J a and corresponding control operation 
C a . It would seem a simple matter to simply insert the control operations into each trajectory 
a time r after each jump. However, in doing so, one encounters a problem: what happens 
when a second jump occurs within the delay time of the first? If we assume that the 
control operation is applied regardless of whether this occurs or not, the trajectories become 
complicated and can not be resummed as a master equation. To avoid this, we assume that 
in the case where a jump occurs in the delay time of a previous jump, the control operation 
of the first jump is simply skipped. In other words, if the time between two subsequent 
jumps is shorter than the delay time, no control operation for the first jump is performed. 
This I shall call the control- skipping assumption. This assumption is a plausible: it is not 
hard to imagine that the feedback electronics be reset by the arrival of a second jump as 
they prepare to enact the control operation of the previous. Certainly, in the case where the 
delay is introduced deliberately, this feedback scheme could be arranged. 

With this assumption, addition of delayed feedback control is effected by the replacement 
of the no-jump propagators following jumps J a as 

O (AT -x / ^o{t)Ja t <r a , , 

U [t)J a | n ^ _ Ta)CMTa)Ja t > Ta > [Z) 

throughout all trajectories. In the first instance, time between the jumps is too short for the 
delayed control to be implemented, in the second line, there is sufficient time and the control 
operation is implemented. For the sake of generality, we have included here a subscript on 
the delay time such that each operation may have its own associated delay. 

With this replacement, the controlled trajectories can still be resummed such that the 
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density matrix in Laplace space reads 



poo J 



with delayed-control superoperator 

V a {z) = 1 + (C a - t)e {w °- z)Ta . (4) 
Translating back into time-domain, we obtain the nonMarkovian QME 



p(t) = f dt> 
Jo 



Pit'), (5) 



with V a (t) = S(t) + (C a — l)e WoTQ 5(t — T a ). Evaluating the delta-functions we obtain the 
delayed QME: 

p(t) = Wp{t) + ^(C Q - l)e WoT "JJ(t - Ta )p(t - r a ), (6) 

a 

in which the time evolution of the density matrix p{t) depends not only on the state of the 
system at time t but also at previous times {t — r a }. The ^-functions that accompany the 
delayed terms mean that, in accordance with the construction of this master equation from 
its specific solution, the history of the system up to time t = is not needed. Furthermore, 
knowledge of the explicit solution allows us to conclude that no positivity or normalisation 
issues arise with this particular nonMarkovian QME. Eq. (jSJ) is a slight generalisation of the 
form given in Wiseman j23|. There, this expression was derived in the framework of the 
stochastic Schrodinger equation as being valid only to first order in the delay time(s). The 
foregoing shows that Eq. (jfjj) is actually valid for arbitrary delay, provided the additional 
control-skipping assumption is made. 

To facilitate the calculation of the FCS of transport processes, we introduce the counting 
fields {Xa} associated with tunneling of electrons into/out of leads {a}. With counting 
fields, and assuming that transport into each lead is unidirectional (infinite bias limit), the 
nonMarkovian Laplace-space delayed-control Liouvillian reads 

Wdc(x,z) = W + X>«(x,*)J'«e* ', (7) 

Q 

with delayed control operation 

V a ( X ,z) = t + [C a (x)-t}e {m ^ z)T , (8) 

where x without subscript refers to the complete set of counting fields. Note that in general 
the control operations C a , and hence V a , can transfer electrons and thus depend on the 
counting fields. Calculating the transport properties of nonMarkovian QMEs is well under- 
stood, see e.g. Emary and Aguado Q, Flindt et al. (Io| . Providing that we start counting 
at t — 0, no inhomogeneous term is required in the QME. 
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FIG. 2. The length of the stationary Bloch-vector of the DQD transport qubit with feedback 
control as a function of delay time r. Results for two strategies of choosing control parameters 
are shown here: oblivious (black solid line) and optimised (blue dashed line). The value of \(tr)\ 
without feedback control is shown (green dotted line). The parameters were e = and T c = 0.241^. 



II. NONEQUILLIBRIUM STATE STABILISATION 

As first application, let us re-analyse the feedback stabilization protocol of Poeltl et al. 
181 ]. this time with delay. The system consists of a double quantum dot (DQD) described by 
the three states: 'empty' |0) and left- and right- occupied states, \L) and \R). The Hamilto- 
nian of the DQD reads -£Tdqd = \ ecr z + Tc<J x with pseudospin operators a z —\L)(L\ — \R)(R\, 
a x =\L) (R\ + \R) (L\. The two transport processes are tunneling into the DQD from the left 
lead, Ll = y/T~L,\L)(Q\, and out to the right, Lr = y/T^\0)(R\. We consider only the e = 
case in the following. 

In Poeltl et al. [l8j, the control operation was chosen as a coherent qubit rotation in x-z 
plane conditioned on the tunnel of an electron into the DQD: 

C L = exp{9 c [sm9X x + cos9E z }}; C R = 0, (9) 

with rotations induced by Pauli matrices T, a p = —i [a a ,p]. By choosing control parameters 
6c and 9 correctly, this control operation was used to rotate the state of the incoming 
electron into an eigenstate of the effective Hamiltonian H = -£Tdqd — ^T^a^a^a, a state 
protected from further evolution until the next jump. In the limit — > oo where state |0) 
can be eliminated (the "transport qubit" limit), the system effectively spends all its time in 
this state, which is thus stabilised. 

Introducing delay through the application of Eq. (j7J) and Eq. (jSJ) we obtain the delayed- 
control kernel 

Wncix, z) = W + J R j*« + V L {z)J L e^\ (10) 
with a delayed control operation that does not depend on counting fields 

V L (z) = t + (C L -t)e^°-^ T . (11) 
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The central question is to what degree can the stationary state of the system (obtained from 
y^Dcix — 0, z = 0)p sta t = 0) be purified by feedback in the presence of delay To this end 
we consider three strategies for choosing the control parameters: 

• We simply use the values from the stabilisation protocol without delay, a strategy 
dubbed 'oblivious control' in Combes and Wiseman [5fl; 



• We choose the angles such that the purity is maximised for a given delay time; 

• Without delay, state stabilisation is correlated with Poissonian statistics of the trans- 
port process. We can therefore attempt to use this same the criterion to set the control 
parameters in the presence of delay. 

Results for the first two strategies are shown in Fig. [2j where we plot as a function of 
delay time the length of the Bloch vector of the stationary state, a measure of the states 
purity (| a \ = 1 for a pure state). Delay clearly serves to reduce the purity of the end state. 
With oblivious control at small delay times, the length of the Bloch vector drops linearly: 

l{(T)l \ 1-IW2 ±T c >r R ' W 

where the two cases arise from a bifurcation in the nature of the stabilisable states without 
delay. In the presence of delay, feedback-control only offers a purity improvement over the 
non-controlled steady-state for delays Trt < 0.2. The reduction of the purity is strongest 
around tTr ~ 1. For large delays tTr 3> 1, the stationary state with control reverts to that 
without since, in this limit, the probability that successive jumps occur within the delay 
time is high and the control operation is only very rarely enacted. 

Explicitly choosing the control parameters to maximise the purity shows a marked in- 
crease in the purity over the oblivious approach. As Fig. [2] shows, the the purity of the 
controlled state with strategy is significantly lies above that of its uncontrolled counterpart 
for most values of the delay. 

Fig. [3] investigates the strategy of choosing the control angles based on the the FCS. Here, 
we just look for a (shotnoise) Fano factor F equal to unity (the Poissonian value) to adjudge 
this. For each value of r there exists multiple choices of control parameters that give F = 1. 
For small delay times IY <C 1, two of these solutions have high purity and are continuous 
with the stabilisable states of the r = system. For small delays, relying on the FCS to 
locate useful control parameters remains a valid strategy. However, above a certain delay 
time, r > 0.1 in Fig. [3^, these high-purity solutions disappear and selecting for F — 1 drives 
the system into one of two highly mixed states. This behaviour is explained in Fig. [3b. 
Away from the small r limit then, the zeroes of F — 1 are unrelated with any kind of purity 
optimisation and this criterion should be avoided. 



III. MAXWELL'S DAEMON 



Schaller et al. [20J described how a single-electron transistor (SET) with feedback can act 
as a Maxwell's Daemon and transfer charge against a voltage gradient whilst no net work is 
performed on the system. Several feedback schemes were discussed in this work, but here 
I shall just discuss 'Scheme Ila' (details below) since this is of the appropriate type for our 
delay treatment. 
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FIG. 3. State stabilisation with control parameters based on the FCS. (a): Length of the Bloch 
vector as a function of delay time. Here the control angle 9 was fixed at at a value 9 = n/2 (the 
non-delayed choice) and angle 9c was chosen such that the Fano factor of transferred charge was 
exactly unity. For each value of the delay, there are several choices of control angles which give 
F = 1 and hence multiple solutions are plotted. The topmost two solutions correspond to the two 
stabilised pure states for r — > 0. Only for T^t < 0.1 do there exist control parameters for which 
i 7 — 1 is zero and the stationary state has a high purity, (b): This behaviour can be explained 
by considering the length of Bloch vector and Fano factor as functions of control angle 9c (with 
9 = vr/2). Results are plotted for zero and finite (r = 0.2r^) delays. At zero delay, the function 
F — 1 crosses the zero axis in four places; two of these solutions correspond to maximum purity 
states; the remaining two, low purity states. For larger delays, r > 0.ir#, the leftmost maximum 
of F — 1 drops below zero and the two high-purity unit-Fano- factor solutions disappear. Parameters 
were as Fig. [2] 



The SET model consists of a quantum dot with just two states: 'empty', |0), and 'full', 
|1), connected to two leads at finite bias and temperature. A quantum point contact is used 
to monitor the charge state of the dot and without feedback, the system Liouvillian reads 

W(xl, Xr) = Wo + Ji( X l, Xr) + Mxl, Xr) (13) 

where counting fields Xl.r keep track of electron movements through the left and right 
barriers of the dot. Since the QPC can only tell us the occupation of the dot (but not 
e.g. from which lead the electron has tunneled), the two jump super-operators on which 
the control scheme is based are Ji and Jo, which describe inward and outward jumps 
respectively. In a the basis {|0), |1)} we have 

w = ^r a F Q °; ji{xL,XR) = Y, T ° F * e ~ iXa > MxL,XR) = J2 T « F « elXa > 

a a 

\ -(1 - f a ) J ' a \0 J ' *° \ 

where T a is the tunnel rate associated with lead a = L,R, and where f a is the corresponding 
Fermi function, f a = [e^ e_AtQ ) + with e the dot level energy,/^ the chemical potential 
of lead a and /3 = 1/ kT the inverse thermal energy. 




7 




FIG. 4. (a) Equillibrium current through the Maxwell daemon SET with delayed feedback as a 
function of delay time r. Results for several values of the Fermi function / are shown. For / = 1/2, 
the decay of the current with r is purely exponential, (b) Power generated by the Maxwell daemon 
SET as a function of bias eV applied symmetrically about the dot level: — e = e — {1r = eV/2. 
Results for several values of the delay r are shown (solid lines) and the maximum power point 
indicated (red dashed line). In both cases, the parameters were 5 J R = 6® = 6 — > oo, b J L = 5^ = 
and T L = T R = T. 



The control scheme Ha of Schaller et al. 2Q] is, on detection of a tunnel event either into 
or out of the system, to change the barrier heights and return them instantaneously. The 
corresponding control operations read 



Ci/o(XL, Xr) = exp fa S t J° (F° + F-e~^ + F+e***)} , 



(15) 



where parameters Sa° describe the 'strength' of the feedback transition involving lead a 
given an in/out jump. For simplicity, let's use the "maximum feedback" case and set 5^ = 
5° = 5 — > oo and 5f = 5% — 0. We will also consider a symmetric SET, Tl = = T. With 
delay, then, the controlled Liouvillian reads 

Wdc(xl,Xr,z) = >V + ^2 T> c l (XL,XR,z)J a (xL,XR) (16) 

a=I/0 

with 

V I/0 {XL, XR, z) = t + {C i/0 (xl, Xr) - 1) e^-K (17) 

These equations are slightly different to Eq. (171) and Eq. (jSJ) since here we have finite bias 
and bidirectional tunneling. The inclusion of delay is directly analogous, however. 

Even with delayed feedback, the current through the SET can be obtained analytically. 
Let us first consider equillibrium conditions such that fL — Ir — f- In this case, the current 
through the SET is 

(i) = vf(i— n f^-W-fW^ + ji-f)^ 

K / J{ J) eW+Wr -/(!-/) (e 2r - + e 4 / r -) ' 1 ; 
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This result is plotted in Fig. Hk. With the dot level placed on resonance with the chemical 
potential of the leads, we have / = 1/2 and the current assumes the simple form 



(I) 




(19) 



such that it is clear that the current is exponentially suppressed by the delay. For Tr <C 1, 
however, the induced current remains close to the r = value. The behaviour for / ^ 1/2 
is a little more complicated but the basic trend is the same. 

Away from equillibrium, the operation of the daemon may be assessed by considering 
the power generated by the device, P = —(I)V. This power is shown for a symmetric bias 
configuration in Fig. Sb for the case of maximum feedback. Irrespective of the value of r, 
this function shows a single maximum as a function of bias. Without delay, the maximum 
power generated by the device is obtained numerically as P ~ 0.084TkT. With increasing 
delay, the maximum power decreases approximately exponentially. The bias at which this 
maximum is reached also moves towards zero. For a delay time Tr = 1 (which represents a 
large delay), the maximum power is P ~ 0.014r&;T. 



IV. PROBING COHERENT OSCILLATIONS WITH DELAYED FEEDBACK 

Whilst the previous two examples illustrate the negative effects of delay on previously 
established feedback schemes, delay may also be used constructively. In this section we inves- 
tigate coherent oscillations of a DQD with delayed feedback as our probe. The model without 
control is the same as in Sec. [Til The feedback scheme we use is to detect jumps through 
the left barrier and conditionally apply the control operation e KR ^ XR ^ with K,r(xr)P = 
A (|0)(-R|p|i?)(0|e* Xfl — ^\R)(R\p— ^p\R)(R\), which constitutes an instantaneous lowering 
and restoration of the right barrier. Parameter A is a measure of the feedback strength. 

Fig. |5] shows the stationary current through the DQD as a function of delay time. When 
the ratio of right to left tunnel rates is small enough, the current shows a pronounced series 
of peaks that occur when the delay time is equal to odd- integer multiples of tt/VL/ . These 
peaks arise when the control operation is enacted just as the electron has completed a half- 
integer number of coherent oscillations starting from the left dot-state. The current consists 
of two components: that which occurs without control, and an extra component induced 
by the feedback operation. As Tr is decreased, the non- feedback component is reduced and 
the oscillations become more pronounced. Furthermore, since the only source of dephasing 
in this model is the coupling to the right lead, decreasing Tr also decreases this dephasing 
and this accounts for the decreased damping that accompanies the increased visibility of the 
oscillations. 

It is clear then that this delayed-feedback scheme allows us to image the coherent os- 
cillations taking place within the DQD. More generally, such schemes provide a way to 
investigate oscillatory behaviour in other transport systems. In this sense, delayed-feedback 
plus current measurement can provide an additional method for studying transport dynam- 
ics, complementary to the finite-frequency current correlations [l5| or pulsed operation 
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FIG. 5. Stationary current through feedback-controlled DQD as a function of delay time, r. The 
delayed control scheme is such that a time r after an electron tunnel into the system from the 
left, the right barrier is dropped and returned instantaneously. A series of peaks in the current is 
observed that occur when the delay time is equal to odd-integer multiples of 7r/f2, the time taken 
for the electron to be coherently transfered across the DQD. Parameters: e = 0, Tc = 31^ and 
dimensionless feedback strength A = 4 



V. MODELLING A FINITE-BANDWIDTH DETECTOR 

The above delay formalism can be adapted to model the effects of a finite-bandwidth 
detector. In a generic (unidirectional) Liouvillian without control each jump operator J a 
for which electrons are being counted is immediately followed by a counting-field factor 
e %Xa . This can be interpreted as the detector reacting instantaneously to the occurrence 
of a system jump. More realistic is that the detector takes a finite time r to react such 
that jumps go undetected if several occur within this detector reaction time. This situation 
is very similar to the delayed-feedback situation described above but instead of having a 
control operator act at a time r after the jump, we have a detection event described by a 
counting-field factor. The Liouvillian for this situation may thus be written 

yV B w(X,z)=W + J2 V c(Xa,z)J a , (20) 

Q 

with delayed counting factor 

V a ( Xa ,z) = 1 + (e*° - l)e( w °- 2 K (21) 

The equations are the same as Eq. (JTj) and Eq. (jSj), but here the counting- field factors occurs 
not in Eq. (1201) but rather in place on the control operation in Eq. (1211) . 

As example, let us consider the SET of section II III (without control) in the infinite bias 
limit ft — > 1, fn — > 0. For symmetric rates, = T R = T, the current detected by counting 
electrons with a detector reaction time of r flowing through the SET reads 

(I)detected = ^R^^- ( 22 ) 
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This shows an exponential suppression due to the detector lag over the actual current flowing, 
which is (J) = Tr/2. With a reliable detector, we should have F r t <C 1 and the detected 
current reads (I) detected ~ (1 - Urt). 

These results can be compared with the "detector-state model" 0, [n|, [l6[. Using an 
additional detector degree of freedom with detector switching rate F D , the detected current 
of the symmetric SET was found to be 

(-0 detected — 2^ R \ + k" ^ = 2T^ 

For a fast detector, T D ^> F R , we may approximate (/)dctcctcd ~ |T_r fl _ Tjf 1 ■ Thus, 

identifying the parameters of these two detector models as r = 2/Fjj, the descriptions of 
the behaviour in the experimentally important regime are consistent. For larger values of 
r, the two models differ: the delayed-counting model predicts an exponential decay of the 
current whereas Eq. f[2Uj) predicts an algebraic one. 



VI. CONCLUSIONS 



The delay formalism described here contains two effects: the obvious one that the control 
operations follow a time r after a jump, but also that control operations are rejected when 
the time between jumps is shorter than the delay time. This second means that in the limit 
tF — > oo (with T the typical rate of the jump processes) the feedback control is completely 
frozen out. Whilst it is interesting to try to relax this second control-skipping assumption, 
without it, a master equation description (even a nonMarkovian one) is not possible. Such a 
control scheme could however be readily simulated. Extension to piecewise-constant control 
schemes, such as Scheme I of Schaller et al. [20| and Schaller 19 1 should also be possible. 

Delay has been seen here to have a negative impact on the stabilisation and Maxwell 
daemon schemes, reducing the purity of the stabilised state and the power production, 
respectively. For small delay times, however, good results are still obtainable. Interestingly, 
the quantum stabilisation scheme appears to be impacted more severely than the effectively- 
classical Maxwell's daemon. The purification effect based on FCS detection disappears 
completely for Ft > 0.1, whereas the Maxwell Daemon is capable of producing some power 
even with a very poor detector Ft > 1. The power drops off exponentially with increasing 
Ft, though. 

In a more positive sense, we have shown how a deliberately-delayed control scheme in- 
troduces a extra time-scale into the system, which can be used as a probe of the transport 
dynamics. 

Whilst we have concentrated on feedback control of quantum transport, these results 
should also be applicable to other systems, e.g. quantum optics. 
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